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Without Templates 


Theorem 1:an xn+...+a1x+a0 is O(xn) for any real numbers an , 
.... a0 and any nonnegative number n. 


With Templates 


anxn+...+alx+a0 is O( xn) for any real numbers an, ..., a0 and any 
nonnegative number n. 


From Harvested File: he__deceives_Report-no-appendix.doc 


Without Templates 


Theorem 1: calling makeLayer with valid inputs (a list of weights and two 
non-zero natural numbers) returns a valid layer recognized by isLayer. 
(“layers.lisp”) 


Theorem 2: calling makeNetwork with valid inputs (a list of non-zero 


natural numbers and a list of weights) returns a valid network recognized by 
isNetwork. (“networks.lisp”) 


With Templates 


calling makeLayer with valid inputs (a list of weights and two non-zero 
natural numbers) returns a valid layer recognized by isLayer. (“layers.lisp”) 


calling makeNetwork with valid inputs (a list of non-zero natural numbers 
and a list of weights) returns a valid network recognized by isNetwork. 


(“networks. lisp”) 
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Without Templates 


Theorem 4:an xn+...+a1x+a0 is @(xn) for any real numbers an , 
.... a0 and any nonnegative number n. 


Let f(x) and g(x) be functions from a set of real numbers to a set of real 
numbers. 


Then 


1. If f(x)/g(x) = 0, then f(x) is o( g(x) ) . Note that if f(x) is o( g(x) ), 
then f(x) is O( g(x) ). 


2. If f(x)/g(x) = oo, then g(x) is o( f(x) ). 

3. If f(x)/g(x) < oo, then f(x) is 8( g(x) ). 

4. If f(x)/g(x) < oo, then f(x) is O( g(x) ). 

For example, 

(4x? + 3x? + 5)/(x* — 3x? — 5x -4) 

= (4/x + 3/x 24+ 5/4) 1 - 3/X -5/X 3 -4/x 4) =0. 
Hence 

(4x3 + 3x2+5) is 0(x4-3x3-5x-4), 

or equivalently, (x4-3x3-5x-4)is @(4x3 + 3x2+5). 


Let us see why these rules hold. Here we give a proof for 4. Others can be 
proven similarly. 


Proof: Suppose f(x)/g(x)=C1 < oo. 

By the definition of limit this means that 

Ve> 0, dno such that |f(x)/g(x) — C1] < ¢« whenever x >no 
Hence —e< f(x)/g(x) — C1l< € 

Hence —€+C1< f(x)/g(x)< € +C1 

In particular f(x)/g(x)< € +C1 

Hence f(x)< (€ +C1)g(x) 

Let C = € +C1 , then f(x)< Cg(x) whenever x > no. 


Since we are interested in non-negative functions f and g, this means that 


f(x) | C | g@) | 
Hence f(x) = O( g(x) ). 


With Templates 


anxn+...+alx+a0 is @0(xn) for any real numbers an, ..., a0 and any 
nonnegative number n . 


Let f(x) and g(x) be functions from a set of real numbers to a set of real 
numbers. 


Then 


1. If f(x)/g(x) = 0, then f(x) is 0( g(x) ) . Note that if f(x) is o( g(x) ), 
then f(x) is O( g(x) ). 


2. If f(x)/g(x) = oo, then g(x) is o( f(x) ). 


3. If f(x)/g(x) < co, then f(x) is 0( g(x) ). 


4. If f(x)/g(x) < co, then f(x) is O( g(x)). 

For example, 

(4x3 + 3x2 + 5)/(x4 — 3x3 — 5x -4) 

= ( 4/x + 3/x2 + 5/x4 )/(1 - 3/x - 5/x3 - 4/x4) =0. 

Hence 

(4x3 +3x2+5) is o(x4-3x3-5x-4), 

or equivalently, (x4-3x3-5x-4)is @(4x3+3x2+5). 


Let us see why these rules hold. Here we give a proof for 4. Others can be 
proven similarly. 


Proof: Suppose f(x)/g(x)=Ci < co. 

By the definition of limit this means that 

Ve> 0, dn0 such that |f(x)/g(x) — C1] < e whenever x > nO 
Hence —¢ < f(x)/g(x) - C1 <e 

Hence —e +C1 < f(x)/g(x) < ¢€ +C1 

In particular f(x)/g(x) < ¢ +C1 

Hence f(x) < (€ +C1)g(x) 

Let C = € +C1 , then f(x) < Cg(x) whenever x > n0. 


Since we are interested in non-negative functions f and g, this means that 
|f(x) | <C | g(x) | 


Hence f(x) = O( g(x) ). 
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